r 


AD-A261  419  :ntation  page 


form  Apprwto 
OM9  No  0/04-0IM 


Mt*q  to  <.t>aa»  ■  'lut  o»*  "crwaiAd  i>.«  t,mr  onuuciiom  Monmn,  o*t»  >ov»c«o  i 

rfvtvmMiin^toiiwiono' ■•"’''••nan  Sxw  mnoMtut  mhuk  n,  — —  -f—  -<  ■■■•  j 

i »  ■«■!  nrt«»«  s<«v»««  ,■,>«>>»»..«»<»  n—..——  |-g -,jp|-,|  <  i  1 1  .tnvrwi  I 

Di.ittttoi"***- >i«i«  i<C4  ^riinqton  4t«i  m  wtoinmum  «f«uao«t.  »»et»»»an  «>*«MC'iio»t»'’W<tatO?C*4im.  wrwow^Mi,  OC  JiMI  i 


1.  AGEMCr  USE  ONLY  >.««««  oan«;  E.  »!POf(T  DATE 

13  January  1393 


4.  TITLE  ANO  SUITITLE 

Final  Technical  Report,  Grant  AFQSR-91-0089, 
15  Nov  90  -  14  Nov  92 


J.  REPORT  TYPE  ANO  OATES  COVERED 

Final  Report  (15  Nov  90-14  Nov  92’ 


S.  FUNOtNG  NUMIERS 


6.  AUTHOMS) 


Stephen  M.  Robinson 


DTIC 

ELECTE 


9.  SPOMSOMNG/ MONITORING  AGENCY  NAME(S)  ANO  AOORESS(ES) 


Air  Force  Office  of  Scientific  Research 
110  Duncan  Avenue 

Bolling  Air  Force  Base,  DC  20332-0001 


G  AFOSR-91-0089 


8.  PERPORMING  qrganuation 
REPORT  NUMRtft 


10.  SPONSORING /MONITORING 
AGENa  REPORT  NUMRER 


12a.  DISTRIBUTION /AVAILAWUTY  STATEMENT 


12b.  DISTRIBUTION  CODE 


Approved  for  public  release;  dlscribucion  unltmlced. 


13.  ABSTRACT  iMttimum  JOC  worasi 

The  principal  objectives  of  this  research  project  were  (1)  improvenent  of 
algorithms  for  solving  large-scale,  block-structured  convex  programming  problems, 
(2)  approximation  of  optimization  problems  for  purposes  of  computational  solution, 
and  (3)  improvement  of  algorithms  for  nonsmooth  optimization,  as  well  as  (A)  use 
of  the  research  results  to  improve  problem-solving  ability  in  application  areas. 
Progress  was  achieved  in  all  of  these  areas,  and  was  documented  in  eight  papers 
prepared  for  journal  publication  as  well  as  one  Ph,D.  dissertation  and  two 
technical  reports. 


^^il|93-04946 


14.  SUBJECT  TERMS 


Nonsmooth  optimization,  convex  programming,  large-scale 
optimization 


IS.  NUMBER  OP  RAGES 


18.  PRia  COOS 


17.  SECURITY  CLASSIPICATION  18.  SECURITY  CLASSIFICATION  19-  SECURITY  CLASSIFICATION  20.  LIMITATION  OF  ABSTRACT 
OF  REPORT  OF  ABSTRACT 

ONCLASSIITCT  UNCLASSIFIED  UNCLASSIFIED  UL 


GENERAL  INSTRUCTIONS  FOR  COMPLETING  SF  298 


The  Report  Documentation  =age  (RDP)  is  useo  m  announcing  and.  cataloging  reports,  it  is  important 
that  this  information  oe  consistent  witn  tne  rest  of  the  reoon.  paaicuiany  me  cover  ana  title  page 
Instruaions  for  filling  m  eacn  diock  of  me  form  fonow  it  is  impoaant  to  stay  withm  the  lines  to  meet 
optical  scanning  requirements. 


Block  1 .  Aoencr  Use  Only  (Leave  blank 


Block  2.  Report  Date.  Full  ouQlication  gate 
including  oay,  monm,  and  year,  if  availaoie  (e  g.  1 
Jan  88).  Must  cite  at  least  the  year 

Block  3.  Type  of  Report  ana  Dates  Covereo. 
State  whether  report  is  interim,  final,  etc.  if 
applicable,  enter  inclusive  report  dates  (e  g.  10 
Jun87-30Jun  88). 

Stock  4.  Title  and  Subtitle.  A  title  is  taken  from 
the  part  of  the  report  that  provides  the  most 
meaningful  and  complete  information.  When  a 
report  IS  prepared  m  more  than  one  volume, 
repeat  the  primary  title,  add  volume  numoer,  and 
include  subtitle  for  the  specific  volume.  On 
classified  documents  enter  the  title  classification 
in  parentheses. 

Block  5.  Funding  Numbers.  To  include  contraa 
and  grant  numoers;  may  include  program 
element  number($),  project  number(s),  task 
number(s),  and  work  unit  number(s).  Use  the 
following  labels: 


Contraa 

Grant 

Program 

Element 


Projea 

Task 

Work  Unit 
Accession  No. 


Blocks.  Author(s).  Name($) of person(s) 
responsible  for  writing  the  report,  performing 
the  research,  or  credited  with  the  content  of  the 
report.  If  editor  or  compiler,  this  should  follow 
the  name(s). 

Block  7.  Performing  Organization  Namgis)  and 
Addressfes).  Self-expianatory. 

Block  8.  Performing  Organization  Reoon 
Number.  Enter  the  unique  aipnanumeric  report 
numoerfs)  assigned  by  the  organization 
performing  the  report. 


Name(s) 


Block  9.  Sponsoring/Monttoring  Agency  ^ 
and  Address(es).  Self-explanatory. 

Block  10.  Soonsoring/Monitoring  Agency 
Report  Numoer  (If  known) 


Block  11.  Supplementary  Notes.  Enter 
information  not  included  eisewnere  such  as: 
Prepared  in  cooperation  with...;  Trans,  of ..  ,  To  be 
published  in....  When  a  report  is  revised,  include 
a  statement  whether  the  new  report  superseoes 
or  supplements  the  older  report. 


Block  12a.  DistriOution/Availabilitv  Statement. 


Denotes  ouolic  availability  or  limitations.  Cite  any 
avaiiaoiiity  to  the  public.  Enter  aoditionai 
limitations  or  special  marmngs  in  all  capitals  (e  g 
NOCQRN.REL,  ITAR). 


See  DoDD  5230.24,  'Distribution 
Statements  on  Technical 
Documents. ' 

See  authorities. 

See  Handbook  NHB  22C0.2. 
Leave  blank. 


DOE 

NASA 

N71S 


Block  12b.  Distribution  Code. 


NASA 

N71S 


Leave  blank. 

Enter  DOE  distribution  categories 
from  the  Standard  Distribution  for 
Unclassified  Scientific  and  Technical 
Reports. 

Leave  blank. 

Leave  blank. 


Block  13.  Abstraa.  include  a  brief  (Maximum 
200  words)  faaual  summary  of  the  most 
significant  information  contained  in  the  report. 

Block  14.  Subiea  Terms.  Keywords  or  phrases 
identifying  ma)or  subjeas  m  the  report. 

Block  15.  Number  of  Pages.  Enter  the  total 
number  of  pages. 

Block  16.  Price  Code  Enter  appropriate  price 
code  (WT/S  only) 

Blocks  17.  - 19.  Security  Classifications.  Self- 
explanatory.  Enter  u.S.  Security  Classification  m 
accordance  with  U.S.  Security  Regulations  (i  e., 
UNC1_ASSIFIED).  If  form  contains  classified 
information,  stamp  classification  on  the  top  and 
bottom  of  the  page. 


Block  20.  Limitation  of  Abstraa.  This  block  must 
be  completed  to  assign  a  limitation  to  the 
abstraa.  Enter  either  UL  (unlimited)  or  SAR  (same 
as  report).  An  entry  in  this  block  is  necessary  if 
the  abstraa  is  to  be  limited.  If  blank,  the  abstraa 
is  assumed  to  be  unlimited. 


Sundara  Form  298  a«cX  (Rev.  2-89) 


1.  Abstract 


Final  Technical  Report 

Computacion  and  Theory  in  Large-Scale  Optimization 
Grant  No.  AFOSR-91-OOS9 
University  of  Wisconsin-Madison 


Accesioit  for 


rNTlS  CRAil 

i  DKC  TAB 

□ 

U?i<)r'ioi.>''ced 

ri 

By 

Diitribulion/ 

Availability 

Codes  1 

- - - i 

I  Disl 


Audil  and  lor 
Special 


The  principal  objectives  of  this  research  project  were  (1)  improvement  of  algorithms  for 
solving  large-scale,  block-structured  convex  programming  problems.  (2)  approximation 
of  optimization  problems  for  purposes  of  computational  solution,  amd  (3)  improvement  of 
algorithms  for  nonsmooth  optimization,  as  well  as  (4)  use  of  the  research  results  to  improve 
problem-solving  ability  in  application  areas.  Progress  was  achieved  in  ail  of  these  areas, 
and  was  documented  in  eight  papers  prepared  for  journal  publication  as  well  as  one  Ph.D. 
dissertation  and  two  technical  reports. 


2.  Overview  of  Research  Accomplished 

This  over\'iew  is  organized  according  to  the  major  categories  in  the  abstract  above. 

1.  Improvement  of  algorithms  for  large-scale  optimization. 

The  main  effort  in  this  area  was  devoted  to  improvement  of  methods  for  solving  so- 
called  scenario  analysis  problems:  that  is.  problems  of  (possibly  multistage)  stochastic 
optimization  in  which  the  uncertainties  are  finitely  distributed.  Work  under  this  project 
succeeded  in  demonstrating  that  a  decomposition  technique  based  on  the  bundle  method 
for  solving  nonsmooth  optimization  problems  was  effective  in  solving  loosely- coupled  sce¬ 
nario  analysis  problems.  Computational  comparisons  showed  that  for  such  problems  the 
bundle  decomposition  method  performed  much  faster  (up  to  a  factor  of  1.500)  than  the 
progressi^'e  hedging  algorithm  (the  other  currently-proposed  candidate  for  solving  scenario 
analysis  problems).  This  work  on  scenario  einalysis  is  documented  in  the  dissertation  [Dlj. 
the  journal  paper  [P8],  and  the  technical  reports  [Rlj.  [R2].  from  which  further  information 
can  be  obtained. 

2.  Approximation  of  optimization  problems. 

Basic  research  on  approximation  of  normal  maps,  a  kind  of  nonsmooth  function  that 
can  be  used  in  equations  to  model  necessary  conditions  for  optimization  or  equilibrium 
problems,  is  contained  in  [PI],  [P2|,  and  (Poj.  The  paper  [PI]  develops  homeomorphism 
conditions  that  are  sufficient  to  permit  a  classical  embedding  method  to  be  used  to  solve 
such  equations.  This  method  initially  uses  very  simple  functions  as  approximations,  then 
successively  deforms  the  approximations  into  the  functions  actually  appearing  the  problem. 
A  more  sophisticated  (homotopy)  method  that  can  be  used  when  these  conditions  do  not 
hold  is  currently  under  development. 

[P2]  contains  necessary  and  sufficient  conditions  for  application  to  normal  maps  of  the 
implicit-function  theorem  previously  developed  by  the  principal  investigator.  This  theorem 
provides  the  foundation  for  local  approximation  of  such  functions,  including  computational 
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estimates.  [Pol  shows  how  to  obtain  the  results  of  'P2!  in  a  much  .simpier  way  if  a  certain 
derivative  matrix  appearing  in  the  problem  is  symmetric.  This  symmetry  occurs,  in  par¬ 
ticular.  in  those  normal  maps  arising  from  optimization  problems  over  poiyhedrai  convex 
sets. 

3.  Improvement  of  algorithms  for  nonsmooth  optimization. 

The  main  progress  in  this  area  was  the  further  development  of  a  Xewton  methoa  for 
solving  nonsmooth  equations,  including  those  obtained  from  the  necessary  conditions  for 
optimization  or  equilibrium  problems.  This  method  approximates  the  nonsmooth  equa¬ 
tion  being  solved  by  a  local  model  generated  using  a  point-based  approximation.  This  local 
model,  although  generally  also  nonsmooth,  is  in  many  practical  cases  easy  to  solve.  By  solv¬ 
ing  a  sequence  of  such  problems  one  approximates  the  solution  of  the  original  nonsmooth 
equation.  This  work  is  documented  in  [P7].  .\s  its  basic  technique  uses  approximation,  u 
also  contributes  to  objective  (2). 

f.  Improving  problem-solving  in  applications  areas. 

[P3],  [P4],  and  [P6)  applied  convex  analysis  to  solution  techniques  for  certain  applied 
problems.  [P3]  and  [P4]  dealt  with  military  force-modeling  problems  in  which  it  is  im¬ 
portant  to  estimate  the  relative  contribution  of  different  systems  on  the  battlefield.  The 
results  reported  there  show  that  the  so-ctJled  “eigem-alue  weights. "  which  have  appeared 
in  force-modeling  research  since  the  late  1960s.  are  actually  meurginal  values,  and  therefore 
that  they  can  be  used  to  estimate  relative  contributions  of  different  systems.  [P6]  applies  a 
similar  approach  to  the  problem  of  cost/benefit  analysis  with  incommensurable  attributes. 
It  shows  that,  in  particular,  the  importance  weights  computed  by  the  popular  .Analytic 
Hierarchy  Process  measure  the  effect  of  attribute  tradeoffs  on  a  benefit/cosi  ratio.  This 
provides  an  explanation  of  the  function  of  these  weights,  where  previously  none  had  been 
available, 

3.  Results  from  Research  Activity 

The  following  scientific  works  acknowledge  support  from  Grant  .A.FOSR-91-OOS9. 

a.  Dissertation. 

[Dl]  B.J.  Chun,  Scenario  .Analysis  Modeling  and  Decomposition  slethods  for  Optimiza¬ 
tion  Under  Uncertainty.  Ph.D.  Dissertation,  Department  of  Industrial  Engineering. 
University  of  Wisconsin-Madison.  .August  1992. 

b.  Papers. 

[PI]  S.M.  Robinson.  "‘Homeomorphism  conditions  for  normal  maps  of  polyhedra,"  in:  .4. 
Ioffe,  M.  Marcus,  and  S.  Reich,  eds..  asl  Optimization  and  Nonlinear  .Analysis.  Long¬ 
man  (Pitman  Research  Notes  in  Mathematics  Series,  No.  244).  Harlow.  Essex.  England 
(1992)  240-248. 

[P2]  S.M.  Robinson.  “Normal  maps  induced  by  linear  transformations."  Mathematics  of 
Operations  Research  17  (1992)  691-714. 

[P3]  S.M.  Robinson,  “Shadow  prices  for  measures  of  effectiveness.  I:  Linear  model."  ac¬ 
cepted  by  Operations  Research. 

[P4|  S.M.  Robinson.  “Shadow  prices  for  measures  of  effectiveness.  IL  General  model, 
accepted  by  Operations  Research. 
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[Pol  S.M.  Robinson.  "Xonsingularity  and  symmetry  for  linear  normal  maps.  "  accepted  by 
Mathematical  Programming. 

[P6|  S.M.  Robinson.  ’Minimax  cost/benefit  analysis."  Manuscript.  August  1992.  submitted 
to  Management  Science. 

[P7]  S.M.  Robinson,  "Newton's  method  for  a  class  of  nonsmooth  functions. '  revised  version 
of  November  1992.  submitted  to  Set- Valued  Analysis. 

[P8]  B.J.  Chun  and  S.M.  Robinson.  "Scenario  analysis  via  bundle  decomposition." 
Manuscript.  December  1992.  submitted  to  Annals  of  Operations  Research. 

C.  Technical  Reports 

[Rl]  B.J.  Chun.  S.J.  Lee.  and  S.M.  Robinson.  ".An  implementation  of  the  bundle  decompo¬ 
sition  algorithm."’  Technical  Report  No.  91-6.  Department  of  Industrial  Engineering. 
University  of  Wisconsin-Madison.  .August  1991. 

[R2]  B.J.  Chun,  "Scenario  analysis  modeling  and  decomposition  methods,"’  Technical 
Report  No.  92-8,  Department  of  Industrial  Engineering.  University  of  Wisconsin- 
Madison,  1992. 

4.  Participating  Professionals 

The  following  professional  personnel  received  sMary  support  from  Grant  .AFOSR-91-0089. 

-  Bock  Jin  Chun.  Research  .Assistant. 

-  Mohamed  N.  .Azai'ez.  Research  .Assistant. 

-  Sang  Jin  Lee.  Research  .Assistant. 

-  Laura  Morley,  Research  .Assistant. 

-  Yonca  .A.  Ozge,  Research  .Assistant. 

-  Stephen  M.  Robinson.  Professor. 

-  Hichem  Sellami.  Research  .Assistant. 

5.  Degrees  Awarded 

B.J.  Chun  received  the  degree  of  Doctor  of  Philosophy  (Industrial  Engineering)  in  .August 
1992.  .Among  the  other  participants,  M.N.  .Aza'i'ez.  S.J.  Lee.  A". .A.  Ozge.  and  H.  Sellami 
are  continuing  students  in  the  doctoral  program  (in  Industrial  Engineering  except  for  S.  ,1. 
Lee.  who  is  in  Business),  and  are  expected  to  receive  degrees  in  the  future. 

6.  Inventions  and  Patent  Disclosures 

During  the  work  under  this  grant,  there  were  no  inventions  that  appeared  to  have  any 
patent  possibilities.  Other  (non-patentable)  discoveries  are  contained  in  the  papers  re¬ 
ported  above. 

7.  Other  Information 

Further  information  about  any  of  the  activities  reported  above,  or  other  aspects  of  this 
research  program,  can  be  obtained  from  the  principal  investigator,  Stephen  M.  Robinson, 
at  the  Department  of  Industrial  Engineering.  University  of  Wisconsin-Madison.  1513  Uni¬ 
versity  Avenue.  Madison.  WI  53706-1572.  telephone  (60S)  263-6862.  fax  (608)  262-8454. 
email  smr  0cs.wisc.edu. 
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